High-performance scientific data management system
نویسندگان
چکیده
منابع مشابه
High-performance scientific data management system
Many scientific applications have large I/O requirements, in terms of both the size of data and the number of files or data sets. Management, storage, efficient access, and analysis of this data present an extremely challenging task. Traditionally, two different solutions have been used for this task: file I/O or databases. File I/O can provide high performance but is tedious to use with large ...
متن کاملMeta-data Management System for High-Performance Large-Scale Scientific Data Access
Many scientific applications manipulate large amount of data and, therefore, are parallelized on high-performance computing systems to take advantage of their computational power and memory space. The size of data processed by these large-scale applications can easily overwhelm the disk capacity of most systems. Thus, tertiary storage devices are used to store the data. The parallelization of t...
متن کاملBig Data in High Performance Scientific Computing
Computation in science and engineering can be regarded as a focal point around which "revolves" the need to have knowledge of computer architecture, operating system, network technology, programming language, numerical algorithms, mathematical model, physical phenomena and theory of computation, respectively. If we discuss about the cluster or the computing center, and not about the supercomput...
متن کاملA Generic High-Performance Method for Deinterleaving Scientific Data
High-performance and energy-efficient data management applications are a necessity for HPC systems due to the extreme scale of data produced by high fidelity scientific simulations that these systems support. Data layout in memory hugely impacts the performance. For better performance, most simulations interleave variables in memory during their calculation phase, but deinterleave the data for ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Journal of Parallel and Distributed Computing
سال: 2003
ISSN: 0743-7315
DOI: 10.1016/s0743-7315(03)00036-4